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November 26, 2018 

MuckRock News 
DEPT MR 63598 
411A Highland Ave 
Somerville, MA 02144-2516 

Re: Response to Your Public Records Request Received November 14, 2018 - 

2018 PRR #376 

Dear Mr. Harris, 

As required under California Government Code Section 6253(c), this letter is in 
response to your written public record requests pursuant to the California Public 
Records Act (California Govt. Code Section 6250 et seq.) which was received by the 
City Clerk’s Office on November 14, 2018. 

Enclosed is a disk with information responsive to your request. Below please also find 
additional information which is responsive to your request: 

* Any software and algorithms developed for the implementation of the program. I'm 
particularly interested in any algorithms that have a public policy outcome, such as 
providing guidance on a policy or an assessment of an individual. More generally, I 
would like any software that was developed by or with, given to, used by, purchased or 
licensed to this agency for implementation of the above referenced program. This would 
include original source code, any compiled binaries (also known as executables), 
spreadsheets, program scripts, and other digital materials used to calculate any data in 
the above program. It would also include the input training data for machine learning 
algorithms. Collectively, these responsive materials will be referred to as "the software" 
in the following paragraphs. 

All software is developed and managed by PredPol in the cloud, and the 
department does not operate or have access to any source code, executables, 
binaries, spreadsheets or scripts. There is no personally identifiable information 
used in the program. The software does not process any information or make 
any predictions related to individual people. The only data provided to PredPol 
for its predictions is also made generally available to the public. The data 
provided to PredPol is: event date, event location, event date and time, and 
unique idetifier. This is the same data used for training the algorithm. No other 
information is provided to PredPol. No other data is used by PredPol for making 
predictions, 
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The algorithm used by PredPol is publicly available. It has been published in 
peer-reviewed studies and can be viewed at this link: 

https://pdfs.semanticscholar.org/6749/df3577411252f0fab123ec8ca3979285a4f9. 

pdf 


* All instructional materials, presentations and presentation materials (including 
recorded video and audio, PowerPoint files, prepared remarks, and slides formats), and 
other guidance on the use of "the software." This includes any notes taking during 
meetings that discussed the use of the software, any explanations (whether internally or 
externally generated) of how the software works, and any other document that has been 
used to help explain the use of "the software" to any party, including internal 
documentation, public relations materials, and executive summaries. This also includes 
any description of input and output data fields that will aid in understanding the type of 
information that is submitted to the software, and that is produced by the software. 

[El Monte PD can provide any training materials that they have retained.] 

* A copy of any privacy impact assessments, use policies, standard operating 
procedures, data retention policies, legal opinions, warranties, non-disclosure 
agreements, contracts, liability waivers, insurance agreements, Requests for Proposals, 
Responses to Requests for Proposal, Memorandums of Understanding, Letters of 
Interest, usage policies, or informal agreements that reference "the software" or 
otherwise guide it use or the relationship between this agency and the provider or 
developer of the software. 

A copy of the contract between PrePol and El Monte is attached. 

* A copy of any funding opportunity announcements, grant applications and grantor 
status/progress reports, reports to legislative bodies, annual reports that mention the 
use of the Software, as well as audit records, including but not limited to security audits 
of the software, misuse reports, and reports to oversight bodies. 

[If El Monte has anything related to this they can provide it. PredPol does 

not have any of those documents.] 

* A copy of any validation studies conducted with respect to the program or with respect 
to any software or algorithms used in connection with the program, and a copy of any 
records pertaining to inquiries for the need of validation studies, or discussion of 
potential or actual validation studies. By “validation study,” I mean any study designed 
to assess how accurate the program is in predicting what it is supposed to predict, or to 
assess whether the program may err in the direction of either under- or overestimating 
likelihoods or predicted outcomes, or may produce any results that are biased or 
unexpected in any way. 

See attached academic studies. 

* For the aspects of the software that require an input, for example, to compute a value, 
we request a copy of the five most recent sets of data that were used for input, as well 
as the five most recent outputs of the software, in whatever their native format is. If 
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these inputs or outputs include exempt information, we ask that you exempt only that 
information which is specifically exempted from law, and provide the other material. 


The most recent public crime data for the city of El Monte is available here: 
http://www.citv-data.com/crime/crime-EI-Monte-California.html 


This completes our response and this request is now closed. Should you have any 
questions or need any additional information, please do not hesitate to contact my office 
at (626) 580-2016, Monday through Thursday between the hours of 7:00 a.m. to 5:30 
p.m. 


Sincerely, 



Karina Meneses 
Office Assistant 
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